Skip to content

move the LLM instance directly to Assistant to make it cleaner to share with tests#43

Merged
bcherry merged 8 commits intomainfrom
claude/cleaner-model-sharing-node-tYly8
May 7, 2026
Merged

move the LLM instance directly to Assistant to make it cleaner to share with tests#43
bcherry merged 8 commits intomainfrom
claude/cleaner-model-sharing-node-tYly8

Conversation

@bcherry
Copy link
Copy Markdown
Contributor

@bcherry bcherry commented Apr 30, 2026

this gets rid of the awkward AGENT_MODEL constant by just making the LLM an inherent property of the Assistant, which seems more intuitive

I also switched the test judge model to base 5.2 instead of the chat version to make it clearer that you can (and should) use a different model for evals than for core chat.

I'd like to move STT and TTS as well, but I found a bug we need to fix first

also see livekit-examples/agent-starter-python#71

…ith tests

This gets rid of the awkward AGENT_MODEL constant by making the LLM an inherent
property of the Agent, which is more intuitive.

Also switched the test judge model to base 5.2 instead of the chat version to
make it clearer that you can (and should) use a different model for evals than
for core chat.
@bcherry bcherry changed the title Move LLM configuration from session to Agent class move the LLM instance directly to Assistant to make it cleaner to share with tests Apr 30, 2026
@bcherry bcherry requested review from Topherhindman and u9g April 30, 2026 04:43
claude and others added 4 commits April 30, 2026 04:58
The constructor requires an options arg and destructures it; calling
new voice.AgentSession() with no arg throws at runtime.
…e-tYly8' into claude/cleaner-model-sharing-node-tYly8
Comment thread src/agent.test.ts Outdated
claude and others added 2 commits May 4, 2026 22:17
openai 6.36.0 changed its credential check to reject empty-string
apiKey, but @livekit/agents@1.3.x hardcodes apiKey: '' when
constructing its OpenAI client inside inference.LLM. Pin to <6.36.0
until the agents SDK is patched.
@bcherry bcherry requested a review from u9g May 7, 2026 19:22
Comment thread src/agent.test.ts Outdated
@bcherry bcherry requested a review from u9g May 7, 2026 19:47
@bcherry bcherry merged commit e398f85 into main May 7, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants